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1  Introduction 

In  previous  papers  (Gordon  and  Hobbs,  2003,  2004)  we  have  described  a  methodology  for 
determining  what  knowledge  should  be  included  in  the  knowledge  base  for  an  intelligent 
agent,  capable  of  constructing  and  executing  plans  to  achieve  its  goals.  An  intelligent 
agent  is  at  least  a  planning  mechanism,  so  Gordon  (2004)  asked  what  concepts  are  neces¬ 
sary  for  the  common  strategies  that  people  use  in  achieving  their  goals.  He  investigated 
ten  different  domains,  including  politics,  personal  relationships,  artistic  performance,  and 
warfare,  and  collected  372  strategies.  He  authored  representations  of  these  strategies  in 
order  to  identify  a  controlled  vocabulary  involving  of  concepts.  These  concepts  were  cat¬ 
egorized  into  48  different  representational  areas,  such  as  sets,  space,  and  time.  Thirty 
of  the  representational  areas,  involving  635  concepts,  were  concerned  with  commonsense 
psychology;  among  these  are  memory,  knowledge  management,  planning,  and  so  on.  This 
result  by  itself  demonstrates  the  very  great  importance  of  commonsense  psychology  in  the 
construction  of  intelligent  agents. 

Gordon  et  al.  (2003)  then,  to  define  further  each  of  the  representational  areas,  aug¬ 
mented  the  list  of  concepts  by  investigating  the  English  language  expressions  for  concepts 
in  each  area.  The  result  was  a  list  of  528  concepts,  a  set  that  identifies  the  target  coverage 
of  a  formal  theory  of  commonsense  psychology. 

The  authors  began  the  development  of  formal  theories  that  would  encompass  this  list 
of  concepts.  In  our  earlier  work  (Gordon  and  Hobbs,  2003),  we  described  the  first  theory 
we  constructed,  memory,  as  an  illustration  of  the  method.  We  have  now  completed  14  of 
the  30  theories,  and  this  paper  provides  an  overview  of  this  work  as  we  close  in  on  the 
halfway  mark. 

2  Formal  Theories 

We  have  formalized  fourteen  of  the  knowledge  domains  so  far.  Here  we  focus  on  those  that 
provide  an  account  of  how  knowledge  and  intention  lead  to  action:  Memory,  Knowledge 
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Management,  Envisionment,  Goals,  Planning,  and  Execution.  The  first  two  provide  a 
more  extensive  model  of  a  belief  system  than  has  been  traditional  in  theories  of  belief. 
The  third  is  a  first  cut  at  an  axiomatization  of  what  it  is  to  think  about  something.  The 
fourth  and  fifth  begin  to  address  notions  of  intentionality,  and  the  last  one  deals  with 
the  interaction  of  intentions  with  reality.  Thus,  while  we  discuss  only  some  of  thirty 
comnronsense  domains  here,  they  represent  a  broad  range  of  the  most  basic  features  of 
human  cognition,  as  we  normally  conceive  of  it  in  everyday  life. 

A  traditional  problem  in  axiomatizing  a  domain  is  the  problem  of  determining  exactly 
what  the  coverage  should  be.  The  list  of  528  concepts  derived  from  the  study  of  strategies 
and  language  use,  together  with  their  meanings,  provides  the  answer  to  this  question.  The 
formal  theories  must  identify  the  key  central  underlying  concepts  and  define  the  other 
concepts  in  terms  of  these.  A  further  constraint  on  the  construction  of  formal  theories 
comes  from  the  very  size  of  the  set  of  concepts  to  be  explicated.  There  are  logical  relations 
among  the  representational  areas;  e.g.,  the  area  of  Goal  Themes  depends  on  Goals.  Thus, 
more  basic  theories  must  explicate  the  concepts  required  by  the  theories  that  depend  on 
them.  The  entire  effort  must  yield  a  coherent  set  of  theories.  We  cannot  take  shortcuts 
early  in  the  effort  without  undercutting  our  coverage  later. 

We  should  emphasize  that  our  aim  is  to  produce  logical  theories  of  comnronsense  psy¬ 
chological  concepts,  as  indicated  by  strategies  and  language  use,  rather  than  to  formulate 
predictive  psychological  models,  that  is,  a  comnronsense  model  of  human  memory  rather 
than  a  psychological  model  of  human  memory  performance.  In  what  follows,  we  describe 
the  high  points  of  the  theories,  sketching  their  coverage  and  key  ideas. 

3  Memory 

In  most  theories  of  belief,  beliefs  are  not  distinguished  as  to  their  availability  to  inference 
processes  (e.g.,  Moore,  1985).  But  this  is,  sadly,  an  idealization  that  falls  short  of  human 
experience.  We  are  always  forgetting  things  it  would  be  in  our  interests  to  remember, 
remembering  things  just  in  time  or  a  little  too  late,  being  reminded  of  things  out  of  the 
blue,  and  trying  to  recall  things  when  we  need  them. 

The  first  step  we  take  beyond  the  traditional  theories  is  to  introduce  an  internal  struc¬ 
ture  for  the  “mind”  that  contains  the  beliefs.  A  person’s  mind  has  a  “focus  of  attention”, 
or  simply  “focus” ,  and  a  “memory” .  Concepts  that  are  “in  mind”  ( inm )  are  in  focus  or  in 
memory.  In  our  theories  of  other  areas,  such  as  Envisionment,  certain  actions  on  concepts 
require  the  concepts  to  be  in  focus.  For  example,  you  can’t  consider  the  consequences  of 
some  event  without  attending  to  the  event  consciously.  Concepts  can  be  stored  in  memory 
and  can  be  retrieved  from  memory. 

per-son(p)  D  (3  x)mind(x,p)1 

1  Axioms  without  outermost  quantifiers  are  assumed  to  be  universally  quantified  over  the  variables 
occurring  in  the  antecedent  of  their  highest  level  implication. 
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mind(x,p)  D  (3  f)focus(f,p)  A  part(f,x) 
mind(x,p )  D  ( 3m)memory(m,p )  A  part(m,x) 

To  think  of  something  is  to  have  it  in  focus. 

think- of(p,c )  =  (3  /)[mm(c,  /)  A  focus(f,p )] 

The  second  step  we  take  beyond  the  traditional  theories  is  to  introduce  a  notion  of 
the  “accessibility”  of  concepts  in  memory.  Accessibility  is  a  partial  ordering.  There  is  a 
memory  threshold  such  that  when  the  accessibility  of  a  concept  falls  below  it,  it  can  no 
longer  be  retrieved.  The  concept  has  been  forgotten.  The  greater  the  accessibility,  the 
easier  it  is  to  retrieve  into  focus. 

We  posit  a  general  notion  of  “association”  between  concepts  that  encompasses  relations 
like  implication,  among  others.  When  a  person  retrieves  a  concept,  this  action  increases 
the  accessibility  of  the  concepts  with  which  it  is  associated.  This  gives  the  person  some 
control  over  the  retrieval  of  forgotten  concepts. 

A  more  complete  account  of  our  Theory  of  Memory  is  presented  in  Gordon  and  Hobbs 
(2003,  2004). 

4  Knowledge  Management 

This  theory  concerns  the  properties  of  beliefs  and  how  they  are  organized.  We  first  of  all 
have  a  standard  theory  of  belief.  Beliefs  are  relations  between  an  agent  and  a  proposition. 
Agents  can  use  modus  ponens;  that  is,  there  is  a  defeasible  inference  that  if  an  agent 
believes  P  and  believes  P  implies  Q,  then  the  agent  believes  Q.  This  is  only  defeasible 
since  we  would  have  logical  omniscience  otherwise.  More  particularly,  if  an  agent  believes 
P  and  has  P  in  focus,  and  believes  P  implies  Q  (in  focus  or  not),  then  defeasibly  the  agent 
will  come  to  have  Q  in  focus  and  will  believe  it. 

Other  central  properties  of  belief  await  the  development  of  other  theories.  The  fact 
that  people  generally  believe  what  they  perceive  awaits  a  Theory  of  Perception.  The  fact 
that  they  often  believe  what  they  are  told  will  be  handled  in  a  Theory  of  Communication. 
The  fact  that  we  act  in  a  way  that  tends  to  optimize  the  satisfaction  of  our  desires  given 
our  beliefs  will  be  dealt  with  as  we  develop  our  Theory  of  Plans  more  extensively. 

Propositions  can  be  proved  from  other  propositions.  Partial  proofs  consisting  of  plau¬ 
sible  propositions  tend  to  justify  beliefs.  Knowledge  is,  or  at  least  entails,  justified  true 
belief  (Chisolm,  1957,  although  cf.  Gettier,  1963). 

In  addition,  we  have  sketched  out  a  theory  of  “graded  belief’.  Agents  can  believe 
propositions  to  some  degree.  Degree  of  belief  is  a  partial  ordering.  Some  of  the  key 
properties  of  graded  belief  are  that  degree  of  belief  does  not  diminish  under  modus  ponens, 
that  the  degrees  of  belief  of  a  proposition  and  its  negation  vary  inversely,  and  that  multiple 
independent  supports  for  a  proposition  tend  to  increase  its  degree  of  belief.  Graded  beliefs 
over  some  threshold  become  full-fledged  beliefs. 
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We  have  axiomatized  graded  belief  in  a  very  abstract  and  noncommittal  manner,  in  a 
way  that,  for  example,  accommodates  Friedman  and  Halpern’s  (1999)  approach  to  non¬ 
monotonic  reasoning. 

We  define  a  notion  of  “positive  epistemic  modality” .  Positive  epistemic  modalities  are 
preserved  under  modus  ponens.  In  addition  to  belief  and  graded  belief,  suspecting  (be¬ 
lieving  P  more  than  P),  assuming,  and  mutual  belief  are  all  positive  epistemic  modalities. 

Mutual  belief  can  be  defined  in  the  standard  way.  If  a  community  mutually  believes 
that  P,  then  each  member  believes  that  P,  and  the  community  mutually  believes  that  it 
mutually  believes  that  P.  We  can  talk  about  communities  and  their  mutual  beliefs.  One 
of  the  most  important  kinds  of  knowledge  we  have  is  knowledge  about  who  knows  what, 
and  much  of  this  is  inferred  from  our  knowledge  of  the  communities  the  agents  belong  to. 
For  example,  we  believe  that  American  citizens  know  the  basic  facts  about  the  American 
government,  and  we  believe  that  AI  researchers  know  about  the  frame  problem. 

5  Envisionment 

The  cognitive  process  of  “thinking”  is  very  hard  indeed  to  pin  down  formally.  Above, 
we  defined  “thinking  of’  a  concept  as  having  that  concept  in  focus.  We  can  and  do 
define  “thinking  that”  a  proposition  is  true,  as  in  “John  thinks  that  the  world  is  flat” ,  as 
believing  the  proposition.  But  “thinking  about”  a  concept,  an  entity,  or  a  situation  can 
cover  a  broad  range  of  complex  cognitive  processing.  Nevertheless,  we  can  begin  to  pin 
down  one  variety  of  such  cognitive  processing — envisioning,  or  beginning  with  a  situation 
and  working  forwards  or  backwards  along  causal  chains  for  the  purposes  of  prediction  or 
explanation. 

We  base  our  treatment  of  envisionment  on  the  formalization  of  causality  in  Hobbs 
(2001,  in  press).  This  paper  introduces  the  notion  of  a  “causal  complex”  for  an  effect; 
essentially,  if  everything  in  the  causal  complex  holds  or  happens,  then  the  effect  happens, 
and  for  any  event  or  state  in  the  causal  complex  there  is  some  situation  in  which  toggling 
it  changes  the  effect.  We  then  say  one  eventuality  is  “causally  involved”  with  an  effect  if 
it  is  in  a  causal  complex  for  the  effect. 

We  define  a  causal  system  as  a  set  of  eventualities  (evs)  together  with  a  set  of  “causally 
involved”  relations  ( rels )  among  them. 

(V s)[causal-system{s)  D  (3 si, S2)[eus(s)  =  s\  A  rels(s)  =  S2]] 

(Vs,  si)[[eus(s)  =  si  A  rels(s)  =  S2] 

=  [ causal- system(s ) 

A  (V e) [member (e,  si) 

D  [eventuality  (e) 

A  (3  ei ,r)[member(r,  S2) 

A  [causally-involved'  (r,  e\,e) 

V  causally-involved1  (r,  e,  ei)]]]j 
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A  (V r)[member(r,  S2 ) 

D  (3ei,e2)[member(ei,  s\)  A  member(e2,  s\) 

A  causally-involved' (r,  ei,  e2)]]]]2 

That  is,  the  eventualities  in  a  causal  system  all  participate  in  some  causally-involved 
relation  in  the  causal  system,  and  every  causally-involved  relation  in  the  causal  system 
is  between  two  eventualities  in  the  causal  system. 

Two  eventualities  e\  and  e2  are  “causally  linked”  in  a  set  of  “causally  involved”  rela¬ 
tions  if  there  is  a  chain  of  relations  in  s  between  e\  and  e2,  regardless  of  direction. 

(V el,  e2,  s)[causally-linked(ei,  e2,  s) 

=  [(3r)[causally-involved'  {r,e i,e2)  A  member{r,  s)\ 

\J  (3r)[causally-involved’ {r,e 2,ei)  A  me?nber(r,  s)\ 

V  (3  e3,r)[[causally-involved' (r,  ei,  e%)  V  [causally-involved1  (r,  e 3,  ei)] 

A  member(r,  s)  A  causally-linked(e3,e2,  s  —  {r}]]] 

A  “connected  causal  system”  is  a  causal  system  in  which  all  eventualities  are  causally 
linked  by  relations  in  the  causal  system. 

(V  s)  [comiected-causal-system(s) 

=  [causal-system(s ) 

A  (Vei,  e2)[[mem&er(ei,  evs(s))  A  member  (e2,evs(s))] 

D  causally-linked(e  1,  e2,  re/s(s))]]] 

Multiple  effects  of  a  cause  can  be  in  the  same  connected  causal  system,  whereas  alternative 
effects  of  a  cause  may  not  be.  The  same  is  true  for  multiple  causes  of  an  effect. 

An  envisioned  causal  system  is  a  causal  system  that  some  agent  thinks  of  and  extends 
forward  and  backward  by  prediction  and  explanation  and  by  exploring  alternatives.  We 
first  define  an  ecs-slice ,  that  is,  a  causal  system  as  it  is  envisioned  at  any  given  instant. 

ecs-slice(s,  a,  t) 

=  causal-system(s) 

A  (Ve) [member (e,  evs(s))  D  think-of(a,e,t)\ 

A  (V r) [member (r,  rels(r))  D  [believe(a,  r)  V  think-of(a,r)]] 

The  agent  a  is  (consciously)  thinking  of  every  eventuality  in  the  cognitive  system  at  time  t. 
a  may  or  may  not  be  thinking  of  all  the  causal  relations.  They  may  be  merely  believed,  not 
even  necessarily  accessible.  For  example,  when  we  rapidly  assess  a  situation  by  intuition, 
we  are  using  causal  knowledge  we  may  not  even  be  aware  of.  On  the  other  hand,  a  may 
consciously  be  thinking  of  and  considering  the  consequences  of  a  causal  rule  he  does  not 
believe.  In  our  full  treatment,  we  also  introduce  a  set  of  background  assumptions  that  are 
not  contradicted  during  the  process  of  envisioning. 

Next  we  characterize  various  ways  in  which  two  causal  system  can  be  contiguous. 

2  A  primed  predicate  (e.g.,  causally-involved' (r,e,e  1))  says  that  its  first  argument  (r)  is  a  reification  of 
the  eventuality  of  its  unprimed  predicate  ( causally-involved )  being  true  of  its  other  arguments  (e,  ei). 
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causally-involved' (r,e i,e)  A  member  (e,evs(s\))  A  ~>member(ei,evs(si)) 

A  evs(s2 )  =  eus(si)  U  {ei }  A  rels(s2 )  =  rels(s i)  U  {?’} 

D  contig-cs(s\,  S2) 

That  is,  adding  an  explanation  of  an  element  of  a  causal  system  results  in  a  contiguous 
causal  system. 

causally-involved' (r,e,e  1)  A  member {e,evs{s\))  A  -^member (ei,evs(si)) 

Aevs(s2)  =  eus(si)  U  {ei }  A  rels(s 2)  =  rels(s  1)  U  {?’} 

D  contig-cs(s\,  S2) 

That  is,  adding  a  prediction  from  an  element  of  a  causal  system  results  in  a  contiguous 
causal  system. 

causally-involved' (r\,e i,e)  A  causally-involved' (r2,e 2,e) 

A  member (e,  evs(s\))  A  7nember(ei,evs(s\)) 

A  ~^member(e2,  evs(s  1))  A  member (r\,r el s(s\))  A  -imem&er(r2,  rels(s2)) 

A  evs(s2 )  =  [eus(si)  -  {ei}]  U  {e2}  A  rds(s2)  =  [rels(s±)  -  {r*i}]  U  {r2} 

D  contig-cs(si,  S2) 

That  is,  substituting  one  cause  for  another  in  a  causal  system  results  in  a  contiguous 
causal  system.  Similarly,  substituting  one  effect  for  another  in  a  causal  system  results  in  a 
contiguous  causal  system.  These  two  rules  give  us  a  way  of  exploring  alternatives  in  causal 
systems.  We  can  think  of  e  in  the  last  axiom  as  a  branch  point.  There  can  be  different 
likelihoods  associated  with  the  different  alternatives,  including  a  likelihood  of  zero.  Some 
branches  are  more  likely  than  others. 

The  contig-cs  relation  is  symmetric. 

contig-cs(si,  s2)  =  conti g-cs (S2,  s  1) 

Thus,  we  can  proceed  by  deleting  causes  and  effects  as  well  as  adding  them. 

These  are  not  necessarily  the  only  ways  in  which  causal  systems  can  be  contiguous, 
but  they  are  the  principal  ones. 

Now  we  can  define  an  envisioned  causal  system  ( ecs )  as  a  sequence  of  envisioned  causal 
system  slices  where  the  causal  systems  are  contiguous  and  where  there  is  a  change  of  state 
from  each  causal  system  slice  being  envisioned  to  the  next  one  in  the  sequence  being 
envisioned. 

ecs(c,  a ,  T) 

=  (\/  s)[member(s,  c)  D  ecs-slice(s,a,t)  A  in(t,T)\ 

A  (3  f)[map(f ,ints(l,  |c|),c) 

A  (V i)[member{i ,  znfs(l,  |c| )) 

D  \i  =  |c| 

V  [contig-cs(f{i),  f{i  +  1)) 

A  (3 1\,  t2)[change(ecs-slice(f  (i) ,  a,  t\) ,  ecs-slice(f  (i+1) ,  a,  t2))]]] 
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Here,  c  is  a  set  of  ecs-slices.  ints(  1,  |c|)  is  the  sequence  of  integers  from  one  to  the  size  of 
c.  map(f ,  ints(  1,  |c|),  c)  says  that  /  is  a  function  mapping  this  sequence  into  the  set  c.  We 
assume  the  ontology  of  time  in  Hobbs  and  Pan  (2004). 

An  “envisioned  causal  system”  is  thus  a  temporal  sequence  of  envisioned  causal  system 
slices.  It  is  a  kind  of  movie  of  what  the  agent  is  thinking  of  as  the  agent  reasons  forwards 
and  backwards  along  causal  chains. 

Envisioned  causal  systems  can  be  purely  fictional  or  imaginary — “What  will  I  do  if  I 
win  the  lottery?”  But  an  especially  important  subclass  of  envisioned  causal  systems  begins 
with  the  world  as  perceived  where  the  causal  relations  are  all  believed  to  be  true.  In  this 
case,  each  envisioned  causal  system  slice  is  the  agent’s  “current  world  understanding”. 

The  Theory  of  Envisionment  thus  provides  the  formal  vocabulary  for  us  to  talk  about 
the  agent’s  instrumental  cogitation  in  trying  to  figure  out  what’s  going  on  in  the  world  now, 
why,  and  what  will  happen  next.  It  is  also  a  way  for  an  agent  to  consider  hypothetical : 
“If  I  do  this  now,  what  will  result?”  This  leads  directly  to  plans  as  a  way  of  achieving 
goals. 

6  Goals  and  Goal  Themes 

Cognition  meets  action  in  the  Theories  of  Goals  and  Planning.  People  are  intentional 
agents.  That  is,  they  have  goals  and  they  devise,  execute,  and  revise  plans  to  achieve 
these  goals.  Other  computational  agents  besides  people  can  be  viewed  as  planning  agents 
as  well,  including  complex  artifacts  and  organizations. 

In  the  treatment  of  causality  in  Hobbs  (2001),  a  distinction  is  made  among  the  elements 
of  a  causal  complex  for  an  effect  between  those  elements  that  cause  the  effect  and  those 
elements  that  merely  enable  the  effect.  Both  imply  a  causally-involved  relation. 

Agents  use  their  knowledge  about  causation  and  enablement  to  construct  plans.  In  the 
traditional  AI  picture  of  planning  (Fikes  and  Nilsson,  1971),  agents  decompose  goals  into 
subgoals  by  determining  everything  that  enables  the  goal  (the  prerequisites)  and  positing 
these  as  subgoals,  and  by  finding  some  complex  of  actions  and  other  eventualities  that 
will  cause  the  goal  to  occur  (the  body).  The  resulting  structure  is  a  “plan”  to  achieve 
the  goal.  More  precisely,  if  an  agent  has  a  goal  and  the  agent  believes  some  eventuality 
enables  that  goal,  then  the  agent  will  adopt  that  eventuality  as  a  goal  as  well.  If  an  agent 
has  a  goal  and  the  agent  believes  some  action  will  cause  the  goal  to  be  satisfied  once  it  is 
enabled,  then  defeasibly  the  agent  will  adopt  the  action  as  a  goal — “defeasibly”  because 
there  may  be  more  than  one  way  to  achieve  the  goal.  Moreover,  having  the  goal  causes 
the  adoption  of  the  subgoal. 

(Vo,  ei,  e2,  g2)[goal' (g2,  a,  e2)  A  know(a,cause(e i,e2)) 

D  (3gi)[goal'(gi,a,e i)  A  cause(g2,g1)  A  subgoal(a,e i,e2)]]3 

'Tor  notational  convenience,  we  sometimes  allow  predications  to  be  arguments  of  other  predicates, 
where  a  proper  treatment  would  reify  the  predications,  as  in  Hobbs  (1985).  Also,  defeasibility  is  not 
indicated  in  the  axiom,  but  it  could  be,  as  in  McCarthy  (1980)  or  in  Hobbs  et  al.  (1993). 
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(\/ a,ei,e2,g2)[goal'(g2,a,e2)  A  know(a,enable(e i,e2)) 

D  (3gi)[goal'(gi,a,e i)  A  cause(g2,gi)  A  subgoal(a,  e1}  e2)]] 

Backchaining  on  these  axioms  while  instantiating  them  with  axioms  expressing  causal 
knowledge  results  in  hierarchical  plans  for  achieving  goals. 

We  can  define  a  plan  p  by  agent  a  to  achieve  goal  g — plan(p,  a,  g) — as  a  composite  entity 
with  a  set  of  subgoals  and  a  set  of  subgoal  relations  among  them.  Then  subgoalIn(e,p) 
says  that  eventuality  e  is  one  of  the  subgoals  of  plan  p,  and  subgoal sO  f(p)  is  the  set  of 
subgoals  of  p. 

It  is  sometimes  said  that  it  is  a  mystery  where  the  goals  come  from.  But  it  is  easy 
to  get  around  this  difficulty  by  stipulating  that  agents  have  “thriving”  as  their  top-level 
goal. 


(V a)[agent(a)  D  goal(a,thrive(a ))] 

All  other  goals  can  then  be  generated  via  beliefs  about  what  will  cause  the  agent  to  thrive. 
In  the  case  of  most  people,  this  will  involve  surviving,  but  it  is  certainly  possible  for  people 
and  other  agents  to  have  the  belief  that  they  best  thrive  when  the  group  they  belong 
to  thrives,  thereby  placing  other  goals  above  surviving  and  enabling  altruistic  behavior. 
Similarly,  obliteration  may  be  the  best  way  of  thriving  in  some  circumstances.  Thriving 
does  not  necessarily  imply  surviving. 

Individual  persons  and  individual  computational  agents  are  not  the  only  kinds  of  plan¬ 
ning  agents.  It  is  also  possible  for  collectivities  of  agents  to  have  goals  and  to  develop 
plans  for  achieving  these  goals.  For  example,  the  organization  General  Motors  can  be 
viewed  as  an  intentional  agent  whose  goal  is  to  sell  cars.  Its  plan  involves  manufacturing 
and  marketing  cars.  These  plans  must  bottom  out  in  the  actions  of  individual  persons 
or  devices,  or  in  states  or  events  that  will  happen  at  the  appropriate  time  anyway.  The 
structure  of  an  organization  frequently  reflects  the  structure  of  the  plan  the  organization 
implements.  For  example,  a  car  company  might  have  a  manufacturing  and  a  marketing 
division. 

We  can  define  a  collection  of  agents  having  a  shared  goal  in  terms  of  each  of  the 
members  having  the  corresponding  individual  goal  and  there  being  mutual  knowledge 
among  the  members  that  the  collection  as  a  whole  has  that  goal. 

We  define  the  notion  of  a  “goal  theme”  (Schank  and  Abelson,  1977)  as  a  set  of  goals 
that  a  set  of  agents  has.  Goal  themes  are  useful  for  predicting  other  agents’  goals  from 
minimal  knowledge  about  them,  namely,  the  groups  they  belong  to.  If  you  see  an  enemy 
soldier,  you  know  that  he  has  the  goal  of  killing  you.  The  set  of  agents  can  be  characterized 
in  many  ways.  Goal  themes  can  correlate  with  an  agent’s  nationality,  from  a  role  in  an 
organization,  from  a  relationship,  or  from  a  lifestyle  choice,  for  example. 


7  Plans,  Plan  Elements,  and  Scheduling 


Plans  are  what  turn  beliefs  into  actions.  An  agent  figures  out  what  to  do  to  achieve  the 
goals,  and  then  does  it.  But  plans  go  through  a  number  of  stages  from  conception  to 
execution,  and  if  we  are  going  to  be  able  to  make  distinctions  as  subtle  as  those  people 
make  about  that  process,  we  will  have  to  explicate  these  different  degrees  of  commitment. 

We  begin  with  a  simplified  model  that  distinguishes  between  the  belief  system  and 
the  plan.  Agents  reason  about  actions  that  would  result  in  their  goals  being  satisfied; 
this  is  a  matter  of  reasoning  about  their  beliefs,  resulting  in  beliefs  in  large-scale  causal 
rules,  or  “plans  in  waiting”.  This  is  a  variety  of  envisionment.  At  some  point,  an  agent 
“commits”  to  some  of  these  plans  in  waiting,  and  they  become  “plans  in  action” .  This  act 
of  committing  to  a  plan  we  call  “deciding  to” . 

decide-to(a,e)  =  change(e o,ei)  A  not'(e o,ei)  A  goal'(ei,e,a ) 

That  is,  for  a  to  decide  to  do  e  is  for  a  to  change  from  not  having  e  as  a  goal  to  having 
e  as  a  goal.  The  decide-to  predicate  is  a  bridge  from  the  belief  system  to  the  planning 
module.  A  goal  is  a  desire  you  decide  to  achieve. 

The  agent  is  continually  deciding  to  perform  certain  actions  by  committing  to  certain 
goals  and  to  certain  plans  for  achieving  the  goals. 

In  commonsense  reasoning  it  is  possible  for  agents  to  directly  cause  events.  For  exam¬ 
ple,  when  a  dog  gets  up  and  crosses  a  yard,  we  might  say  that  there  were  certain  events 
in  the  dog’s  brain  that  cause  it  to  cross  the  yard.  But  more  often  we  simply  think  of  the 
dog  itself  as  initiating  that  causal  chain.  So  we  introduce  the  notion  of  “directly  cause”  as 
a  place  where  planning  can  bottom  out.  Events  that  are  directly  caused  by  an  agent  are 
like  the  executable  actions  in  planning  systems;  they  are  the  actions  an  agent  can  just  do. 

We  can  posit  a  notion  of  “directly  causes”  ( dcause )  as  a  relation  between  an  agent  and 
an  event,  that  is  true  when  the  agent  causes  the  event  with  no  intermediate,  mediating 
events.  Bodily  events  and  some  mental  events  are  directly  caused  by  the  agent.  So  when  a 
man  moves  his  arm,  he  directly  causes  the  arm  to  move.  Knowledge  about  what  kinds  of 
agents  can  directly  cause  what  kinds  of  events  would  be  expressed  in  axioms  of  the  form 

p(a )  A  q'(e,a,...)  D  dcause' (eo,  a,  e) 

That  is,  if  an  entity  a  is  of  type  p  (an  agent)  and  e  is  a’s  doing  something  of  type  q,  then 
there  is  the  eventuality  eo  of  a’s  directly  causing  e.  For  example, 

person(a)  A  lift'(e,a,x)  A  arm(x,a)  D  (3  eo)dcause' (eo,  a,  e) 

Furthermore,  if  e  actually  occurs,  then  eo  obtains  as  well;  a  directly  caused  p. 

Direct  causality  is  a  variety  of  causality. 

dcause(a,  e)  D  cause(a,  e) 

In  direct  causality,  there  is  no  intermediate  cause. 
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(Va,  e)[dcause(a,  e)  D  -i(3  ei)[cause(a,  ei)  A  cause(e\,  e)]] 

A  plan  is  a  way  of  manipulating  the  causal  structure  of  the  world  to  achieve  one’s  goals.  It 
must  bottom  out  in  events  that  are  assured  to  occur  at  the  proper  time.  There  are  three 
sources  for  this  assurance: 

1.  The  event  is  an  action  on  the  part  of  the  agent  that  the  agent  is  capable  of  carrying 
out  at  the  required  time,  e.g.,  it  can  be  directly  caused  when  enabled. 

2.  The  event  will  happen  anyway  at  the  required  time,  because  of  external  causes. 

3.  The  event  is  an  action  on  the  part  of  another  agent,  who  is  committed  to  perfoming 
the  action  at  the  required  time. 

For  example,  if  you  and  I  have  a  plan  to  start  a  car  by  together  pushing  it  to  the  top 
of  a  hill  and  then  letting  it  roll  down  and  popping  the  clutch,  I  know  the  event  of  my 
pushing  the  car  will  happen  because  I  can  do  that,  I  know  the  event  of  your  pushing  the 
car  will  happen  because  you  have  agreed  to  do  it,  and  I  know  the  car  will  roll  down  the 
hill  because  gravity  will  cause  that  to  happen. 

Desires  and  preferences  can  be  modeled  as  beliefs  about  the  efficacy  of  certain  states 
and  events  causing  the  agent  to  thrive,  or  to  achieve  some  lower-level  goal.  Like  other 
causal  beliefs,  they  play  a  role  in  the  plans  the  agent  derives  for  achieving  goals,  and  thus 
often  find  their  way  into  the  plans  that  are  actually  executed. 

desire(a,e)  =  believe(a,part(e,e 3))  A  believe(a,cause(es,thrive(a)) 

Note  that  this  view  of  action  as  the  execution  of  plans  goes  beyond  our  everyday  notion 
of  planned  behavior — when  someone  whose  head  itches  scratches  it,  this  does  not  seem 
like  a  matter  of  planning.  But  it  certainly  is  instrumental  behavior  that  taps  into  the 
underlying  causal  structure  of  the  world,  and  as  such  can  be  represented  at  a  formal  level 
as  the  execution  of  a  plan.  Similarly,  desires  don’t  feel  like  beliefs,  but  they  can  in  part 
be  modeled  that  way. 

Planning  can  be  viewed  as  a  kind  of  envisioning  where  the  initial  envisioned  causal 
system  is  simply  the  goal  and  the  successive  envisioned  causal  systems  are  hierarchical 
decompositions  of  the  goal,  until  the  agent  reaches  causes  that  are  directly  caused  actions 
of  the  agent’s. 

Scheduling  is  a  matter  of  adding  a  consistent  set  of  temporal  parameters  to  a  plan. 
The  constraints  on  scheduling  derive  from  various  inabilities  to  perform  several  kinds  of 
actions  at  the  same  time,  and  must  be  specified  in  domain  theories.  Once  we  have  made 
explicit  a  schedule  for  an  agent’s  plan,  we  can  talk  about  the  agent’s  “schedule  capacity” 
and  “next  unscheduled  moment”.  A  “deadline”  is  the  time  after  which  a  plan  no  longer 
achieves  it  goal.  A  great  deal  of  discourse  about  scheduling  involves  deadlines  for  tasks  and 
the  “slack”  one  has  for  completing  a  task — “We  have  plenty  of  time”,  “He  finished  in  the 
nick  of  time”.  We  define  slack  as  the  time  between  the  believed  or  estimated  completion 
of  a  task  and  the  deadline  for  that  task. 
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8  Execution  Envisionment  and  Control 


Once  we  begin  to  execute  a  plan,  we  monitor  the  environment  to  see  if  the  goals  are  being 
achieved.  If  they  are  not  or  if  other  events  intervene,  we  can  modify,  postpone,  suspend, 
abort,  resume,  restart,  or  do  a  number  of  other  actions.  The  Theory  of  Execution  Control 
is  about  the  agent’s  manipulations  of  the  plan  as  it  unfolds  in  time.  In  linguistics,  these 
notions  go  under  the  name  “aspect” — is  the  action  completed,  continuing,  just  started,  and 
so  on.  Perhaps  the  best  treatment  of  aspect  from  an  AI  perspective  is  that  of  Narayanan 
(1999),  who  developed  a  detailed  model  of  processes  in  terms  of  Petri  nets,  identifying 
which  parts  of  processes  each  aspect  describes.  In  our  model,  we  carry  this  to  one  more 
level  of  detail  by  defining  various  aspects  in  terms  of  hierarchical  plans. 

Some  basic  concepts  have  to  be  defined  before  we  can  address  the  central  issues  of 
aspect.  We  typically  think  of  goals  and  subgoals  as  states.  But  corresponding  to  every 
such  state,  there  are  one  or  more  actions  or  events  that  will  bring  it  about.  So  we  can 
refer  to  “executing  a  subgoal”  where  we  mean  carrying  out  an  action  that  will  lead  to  that 
subgoal  being  achieved.  In  general,  an  agent  a  executes  an  eventuality  e  in  the  service  of  a 
plan  p  at  time  t — execute(a,  e,  p.  t) — whenever  a  is  the  agent  of  e,  e  is  a  subgoal  in  p,  and 
e  occurs  at  time  t.  An  eventuality  has  been  executed  at  time  t  if  there  is  some  previous 
time  at  which  its  execution  took  place. 

executed(e,p,t )  =  (3a,g,  ti)[plcm(p,  a,g)  A  before(t\,t)  A  execute(a,  e,p,  £1)] 

The  “left  fringe”  of  a  plan  is  the  set  of  actions  that  can  be  initiated  immediately,  before 
any  other  actions  in  the  plan  are  executed — left,-fringe(s,p). 

The  “remaining  plan”  p\  of  plan  p  at  any  given  instant  t  is  that  part  of  the  plan  that 
has  not  yet  been  executed — remaining-plan(pi,  p,t) 

When  we  make  aspectual  statements  about  events,  we  look  at  the  fine  structure  of  the 
event  as  it  is  being  executed  and  say  something  about  that  execution.  The  fine  structure 
of  events  is  captured  in  plans,  or  in  an  equivalent  causal  structure.  Therefore,  this  is  the 
place  in  a  theory  of  commonsense  knowledge  where  a  theory  of  aspect  goes. 

To  start  a  plan  is  to  execute  an  action  in  its  left  fringe. 

start' (e,  a,  p,  t) 

=  (3  g,  s,  e\)\plan(p,  a,  g)  A  left- f ring e(s,p)  A  member (ei,  s) 

A  execute' (e,a,e\,p,t)\ 

This  says  that  e  is  a  starting  by  agent  a  of  plan  p  at  time  t  if  and  only  if  p  is  a  plan  by  a 
to  achieve  some  goal  g  and  e  is  the  execution  of  an  action  e\  by  a  at  time  t  where  e\  is  a 
member  of  the  left  fringe  s  of  the  plan. 

To  continue  to  execute  a  plan  at  time  t  is  to  execute  an  action  the  left  fringe  of  the 
remaining  plan  at  time  t. 

continue' (e,  a,p,  t) 

=  (3g,pi,s,ei)\plan(p,a,g)  A  remaining-plan(p\,p,t)  A  left-fringe(s,pi) 
Amember(ei,s )  A  execute' (e, a, e\,p,t)] 
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To  finish  a  plan  for  achieving  a  goal  g  is  to  execute  the  last  action  in  the  plan. 
finish' (e,  a,p,  t ) 

=  (3  g,ei,pi)\plan(p,a,g)  A  remaining-plan(p\,p,t) 

A  subgoals Of{p\)  =  {ei }  A  execute' (e,  a,  ei,p,  i)] 

Stopping  the  execution  of  a  plan  at  time  t  happens  when  an  element  of  the  plan  was 
being  executed  before  t  and  not  after. 

stop'(e,  a,p,  t) 

=  (3  Tf,  T2)[intMeets(Ti,  T2)  A  endOf(T{)  =  t 

A  (V t  6  Ti)(3  ei)[subgoalOf(ei,p)  A  execute(a,e\,t)] 

A  (Vi  G  T2)[-i(3  ei)[subgoalOf(ei,p)  A  execute(a,  e\,  i)]]] 

It  is  possible  for  a  plan  to  be  stopped  in  the  middle  of  its  execution. 

Once  a  plan  is  stopped,  that  precise  plan  may  no  longer  be  executable,  because  it  may 
have  specified  scheduling  decisions  that  can  no  longer  be  met.  But  it  may  be  possible  to 
achieve  the  same  goal  using  different  temporal  parameters.  In  our  full  treatment,  we  define 
the  relation  same-abstr act-plan  between  two  plans  if  they  differ  only  in  their  temporal 
parameters.  (Ideally,  we  should  extend  this  to  plans  that  also  differ  in  irrelevant  choice  of 
instruments.) 

To  resume  a  plan  is  to  start  a  same  abstract  version  of  the  remaining  plan  after  some 
interval  of  time. 

resume' (e,  a,p,  t) 

=  (3 g,pi,p2,ti)\plan(p,  a,  g)  A  stop(a,p,  t\)  A  before(t\,t )  A  start' (e,  a,p\,t) 

A  same-abstr act-plan(pi,p2)  A  remaining-plan(p2,p,ti)\ 

To  restart  a  plan  is  to  start  it  from  the  beginning  after  having  stopped. 
restart' (e,  a,p ,  t) 

=  (3  g,pi,ti)[plan(p,  a,  g)  A  stop(a,p,  t\)  A  before(ti,  t)  A  start'(e,a,pi,t ) 

A  same-abstr act-plan(pi,p)\ 

To  pause  in  a  plan  is  to  stop  the  execution  of  the  plan,  where  there  will  be  a  resumption. 
pause' (e,  a,p,  t ) 

=  (3  g,ei)\plan(p,a,  g)  A  stop'(e,a,p,t)  A  resume(a,p,t\)  Abefore(t,ti)\ 

A  plan  is  ongoing  for  a  time  interval  T  if  it  is  either  being  executed  or  there  is  a  pause 
in  its  execution.  That  is,  ongoing  spans  pauses. 

ongoing(p,a,T)  =  (V t)[inside(t,T)  D  [continue(a,p,t)  V  pause(a,p,t)]] 

For  an  agent  to  suspend  the  execution  of  a  plan  is  for  the  agent  to  stop  executing  the 
plan,  where  the  agent  has  the  goal  of  resuming  it  at  some  future  time. 
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suspend' (e,  a,p,  t ) 

=  (3g,ei,ti)\plan(p,a,g)  A  stop'(e,a,p,t)  A  goal(resume(a,p,ti),  a) 

A  before(t ,  fi)] 

The  distinction  between  pausing  and  suspending  is  that  with  suspending  there  is  only  the 
intention  to  resume.  The  plan  may  not  actually  be  resumed.  Something  is  not  a  pause 
unless  the  resumption  actually  happens. 

For  an  entity  or  event  x  to  interrupt  the  execution  of  a  plan  is  for  x  to  cause  the 
execution  to  be  suspended. 

interrupt' (e,x,  a, p,t)  =  cause' (e,x,suspend(a,p,t)) 

For  an  entity  or  event  x  to  postpone  the  execution  of  a  plan  of  agent  a’s  from  time  t\ 
to  time  f 2  is  for  x  to  cause  a  suspension  in  the  plan  where  a  has  the  goal  of  resuming  at 
time  t‘2  ■ 

postpone' (e,  x,  a,p ,  ^1,^2) 

=  cause' (e,x,stop(a,p,ti))  A  goal(resume(a,p,  t2),  a)  A  before(ti,  ^2)] 

To  complete  the  execution  of  a  plan  is  to  execute  every  action  in  it. 

complete(a,p ,  t) 

=  (3  g)\plan(p,a,g) 

A  (V  e)  [subgoalIn(e,  p) 

D  (3  ti)[before(t\ ,  t)  V  t\  =  t\  A  execute(e,a,p,t  1)]] 

The  completion  of  a  plan  and  its  success  are  independent  notions.  We  can  execute  all 
the  actions  in  a  plan  and  yet  have  the  plan  fail  for  reasons  beyond  our  efforts.  We  can 
be  in  the  midst  of  executing  a  plan  and  have  the  goal  achieved,  before  we  have  actually 
performed  all  the  actions  in  the  plan. 

To  abort  the  execution  of  a  plan  is  to  stop  the  plan  without  completing  it  and  with 
the  intention  not  to  restart  or  resume  it. 

abort' (e,  a,p,  t) 

=  (3 g,ei)\plan(p,a, g)  A  stop'(e,a,p,t)  A  -1  complete(a,p,t) 

A  (\/ ti)[before(t,ti)  D  goal(not(resume(a,p,ti)),a)\ 

9  Summary  and  Future  Work 

Part  of  the  strong  AI  view  of  people  is  that  they  are  planning  mechanisms,  and  this 
is  reflected  as  well  in  the  way  we  talk  about  people’s  actions  and  in  the  strategies  we 
devise  for  influencing  the  behavior  of  ourselves  and  other  people.  In  the  research  we 
have  described  we  have  developed  a  more  detailed  formal  realization  of  this  picture  than 
has  heretofore  been  available.  We  have  explicated  at  least  one  commonsense  set  of  ideas 
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about  the  structure  of  the  mind,  about  how  one  thinks  about  past,  present,  future,  and 
hypothetical  situations,  how  this  thinking  is  sometimes  translated  into  action,  and  how 
actions  are  monitored  and  controlled. 

Having  completed  the  first  fourteen  of  the  thirty  component  theories  of  commonsense 
psychology,  our  first  priority  for  future  work  is  to  complete  the  remaining  sixteen  theories. 
As  with  the  first  fourteen,  we  anticipate  that  many  of  the  remaining  theories  will  challenge 
some  of  the  simplifying  assumptions  that  have  traditionally  been  made  in  formal  knowledge 
representation  research,  and  perhaps  simplifying  assumptions  we  have  made  as  well.  For 
other  areas  where  little  previous  formalization  work  exists,  we  hope  that  exploring  these 
areas  will  create  an  interest  in  the  development  of  new  competing  theories,  and  hopefully 
a  renewed  interest  in  authoring  formal  content  theories  of  commonsense  reasoning  within 
the  field  in  general. 

Our  second  priority  for  future  work  is  the  validation  of  coverage  and  competency 
of  these  component  theories  for  reasoning  in  practical  situations.  We  are  particularly 
interested  in  validating  these  theories  by  using  them  to  derive  formal  proofs  of  human 
strategies  (Swanson  and  Gordon,  2005).  Our  aim  is  to  demonstrate  that  this  large-scale 
formal  theory  of  commonsense  psychology  closely  parallels  the  knowledge  that  is  employed 
by  people  when  making  judgments  about  the  appropriateness  of  any  given  strategy  for 
achieving  reasoning  goals. 

Our  third  priority  for  future  work  is  to  develop  practical  intelligent  systems  that  utilize 
a  large-scale  formal  theory  of  commonsense  psychology  to  engage  in  reasoning  in  service 
of  their  users’  goals.  In  particular,  we  are  interested  in  applications  that  are  able  to 
capitalize  on  the  substantial  natural-language  resources  that  were  created  as  a  product  of 
our  authoring  methodology. 
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